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SUMMARY  AND  CONCLUSIONS 

' ‘J;  ar&ffl 

Background  and  Purpose 

Approximately  fifteen  percent  of  the  crewmembers  who  must  abandon  disabled  aircraft  do  not 
survive.  This  fatality  rate  has  not  improved  over  the  past  seven  years.  Accordingly,  the  Navy 
initiated  research  to  investigate  alternative  approaches  to  improving  ejection  survival  This  particular 
study  focused  on  die  information  formats  used  in  the  ejection  section  of  the  Naval  Aviation 
Training  and  Operating  Procedures  Standardization  (NATOPS)  manuals,  a major  source  of  ejection 
philosophy,  standards,  and  procedures. 

This  project  was  supported  joindy  by  the  Naval  Ship  Research  and  Development  Center, 
Car  derock,  and  the  Naval  Air  Systems  Command  (Code  531). 

Approach 

The  ejection  section  of  the  T-2  aircraft  NATOPS  manual  was  selected  as  the  target  of  the 
investigation. 

An  analysis  of  ejection  accidents  indicated  that  aircrew  errors  occurred  in  all  phases  of  the 
ejection  and  survival  process.  The  pie-egress  phase  (viz.,  envelope  assessment  and  ejection  decision) 
and  the  survival  and  rescue  phase  recorded  the  highest  error  rates.  A separate  Naval  Safety  Center 
study  showed  that,  on  die  average,  about  40%  of  the  ejection  fatalities  were  caused  by  a delay  in 
initiating  ejection.  These  data  cast  suspicion  on  both  the  envelope  assessment/ejection  decision  and 
the  ejection  procedures  (viz.,  slow  assessment  or  slow  procedure  performance  could  delay  ejection). 

Faults  were  found  in  the  information  presentations  provided  to  guide  both  the  ejection 
envelope  assessment  and  the  equipment  operation. 

State-of-the-art  techniques  were  applied  to  improve  die  relevant  information  presentations  of 
the  NATOPS  manual  An  experiment  waa  designed  in  which  a control  group  of  student  pilots  and 
naval  flight  officers  studied  die  conventional  presentations  while  an  experimental  group  studied  the 
improved  presentations.  Tests  covering  four  content  areas  were  uaed  to  asarss  the  effect  of  die  study 
on  initial  learning  and  retention. 


vii 


Hie  experimental  group  outacored  the  control  group  in  all  four  content  areas.  Regarding  the 
all-important  envelope  assessment,  students  who  studied  with  the  new  material  significantly 
outacored  die  students  given  die  old  presentations. 

Hiis  research  shows  that  the  documentation  used  in  this  evaluation  is  an  effective  and 
inexpensive  means  of  fostering  die  learning  of  ejection  information.  Tliis  is  a significant  finding 
regarding  an  airman’s  performance  of  time-critical  (no  time  to  refer  to  a book  or  chart),  hazardous 
(errors  can  cause  death  or  injury)  actions. 
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AN  EVALUATION  OF  A NEW  FORMAT 
FOR  EJECTION  INFORMATION  IN  A NATOPS  MANUAL 

Background 

The  survival  rate  of  aii  crew  men  who  must  eject  from  disabled  naval  aircraft  has  not  improved 
over  the  past  seven  years  despite  continuing  advancement  in  ejection  seat  design  and  performance 
(see  Figure  1).  Johnson  (1975)  attributes  unsuccessful  ejection  escapes  to  categories  such  as 
equipment  failure,  drowning  and  landing  in  the  fireball.  Nonetheless,  about  65%  of  the  fatalities 
occurred  because  the  ejection  sequence  was  delayed  or  initiated  outside  the  safe  ejection  envelope 
(viz.,  ejection  was  attempted  at  excessive  speed,  at  insufficient  altitude,  or  a combination  of  the 
two). 


Figure  1.  Ejection  survival  percentages. 


Figure  2 presents  a breakdown  of  446  ejections  taken  from  a Naval  Safety  Center  report  (Rice 
and  Austin,  1975).  Forty -two  (74%)  of  the  fifty -seven  ejections  which  occurred  outside  the 
envelope  resulted  in  fatalities.  Only  eighteen  (5%)  of  the  389  ejections  which  occurred  within  the 
envelope  resulted  in  fatalities.  These  data  suggest  that  aircrew  ejection  decisions  could  be  a major 
factor  contributing  to  this  costly  loss  of  life. 
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Figure  2.  Ejection  breakdown. 


Every’s  data  (1974)  identifies  several  egress  difficulties  in  Navy  Vietnam  combat  ejections  (see 
Table  1).  These  problems  are  primarily  procedural  and  are  affected  by  environmental  factors  (i.e., 
darkness  — no  visual  reference;  fire,  smoke,  or  fuel  in  the  cockpit;  disorientation). 
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The  foregoing  studies  suggest  a potential  for  improving  crewmember  performance  in  two  critical 
ejection  areas:  decisionmaking  and  equipment  operation.  To  capture  this  improvement  potential 
the  study  reported  herein  focused  on  the  information  presentation  formats  used  in  the  ejection 
section  of  the  Naval  Aviation  Training  and  Operating  Procedures  Standardization  (NATOPS) 
manuals.  These  manuals  are  a major  source  of  user  information  on  ejection  philosophy,  standards, 
and  procedures. 
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Table  1 

Egress  Difficulties 


Egress  Difficulty 

Percent  of 
Recovered  Cases 
Reporting 

Percent  of 
Prisoner  of  War 
Cases  Reporting 

Buffeting 

11 

11 

G Forces 

8 

27 

Windblast 

20 

24 

Difficulty  locating  canopy 
jettison  mechanism 

1 

1 

Difficulty  releasing 
canopy/hatch 

3 

2 

Failure  to  release 
canopy/hatch 

2 

0 

Difficulty  locating/reaching 

NORMAL  EJECTION  MECHANISM 

7 

17 

Difficulty  locating/reaching 

ALTERNATE  EJECTION  MECHANISM 

2 

4 

Face  curtain  failed  to 

ACTIVATE  SEAT 

2 

4 

Face  curtain  problem 
(locating,  reaching,  etc.) 

2 

12 

Seat  pan  firing  handle  failed 

TO  ACTIVATE  SEAT 

2 

5 

Seat  pan  firing  handle  problem 

1 

Canopy  jettison  failure 
(automatic  means) 

4 

4 

Confusion,  panic,  disorientation 

1 

2 

Darkness  - no  visual  reference 

3 

4 

Fire/smoke/fuel 

12 

Upper  extremities  hit 

COCKPIT  STRUCTURES 

3 

9 

Lower  extremities  hit 

COCKPIT  STRUCTURES 

7 

7 

Man  struck  canopy/canopy  bow 

3 

1 

Flailing  - upper  extremities 

13 

17 

Flailing  - Lower  extremities  13  12 
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Current  NATOPS  manuals  were  examined  to  see  whether  their  presentations  offered  a potential 
to  improve  crewmember  performance.  Johnson  (1975)  analyzed  the  ejection  sections  of  six 
NATOPS  manuals  and  found  little  information  format  consistency  across  the  manuals.  The  number 
of  pages  used  to  describe  the  ejection  envelope  varied  from  one  page  for  the  S3A  to  six  pages  for 
A-7A,  A-7B.  Some  of  the  manuals  relied  on  drawings  to  convey  messages,  while  others  displayed 
pictorial  information  through  photographs. 

The  current  study  examined  relevant  parts  of  selected  NATOPS  manuals  against  format 
practices  designed  to  foster  learning,  recall  and  usability.  These  formatting  rules  were  taken 
from:  Post,  1976;  Post  and  Price,  1974;  Booher,  1972;  and  Sitterley,  1974.  Table  2 shows  that 
seven  formatting  rules  were  violated  consistently  in  all  procedural  presentations;  and  the  manuals 
erred  consistently  on  rules  relating  to  pictorials.  Table  3 shows  the  violation  trends  of  the  four 
sample  NATOPS  manuals  when  assessed  against  rive  formatting  rules  relating  to  decisionmaking.  It 
is  evident  that  the  state-of-the-art  practices  are  not  used  consistently  in  preparing  the  ejection 
portions  of  the  NATOPS  manuals.  These  analyses  suggest  the  following  hypothesis:  consistent  use 
of  selected  formatting  rules  will  improve  the  learning  and  recall  of  knowledge  related  to  the  decision 
to  eject  and  the  procedures  for  operating  the  ejection  hardware. 

The  remainder  of  this  report  describes  an  experiment  conducted  to  investigate  this  hypothesis. 
In  conceiving  the  experiment  it  was  decided  to  use  relatively  naive  subjects.  Accordingly,  the 
experiment  was  designed  around  the  NATOPS  manual  for  the  T-2  aircraft  which  is  used  in  training 
student  naval  aviators  and  student  naval  flight  officers.  Hie  following  sections  cover:  documenta- 
tion improvements,  evaluation  methodology,  results  and  discussion.  Two  appendices  are  included 
on  Statistical  Analysis  and  Test  Development. 
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Table  2 

Compliance  of  Four  Sample  Presentations  (Procedural)  Against  Format  Rules 


Format  Rules 

Aircraft  Manuals 

F-14 

A-7 

AV-8 

F-4 

1.  Isolate  steps 

V 

0 

0 

X 

2.  Six  steps  per  frame 

\/ 

n/ 

V 

V 

3.  Two  or  three  thoughts 
per  step 

V 

v/ 

V 

V 

*4.  Illustrate  each  equipment 
feature 

X 

X 

X 

X 

5.  Label  relevant  equipment 
features 

X 

X 

X 

X 

#6.  Six  labels  per  illustration 

X 

X 

X 

X 

*7.  Illustration  and  text  next 
to  each  other 

X 

X 

v/ 

V 

*8.  Use  line  drawings 

V 

V 

V 

V 

• 9.  Illustrate  user's  view 

X 

X 

X 

X 

*10.  Show  hands  or  body 
features 

X 

X 

X 

0 

• 

11.  Use  2nd  person  imperative 

n/ 

V 

V 

v/ 

* 12.  Use  blow-ups  to  aid 
recognition 

X 

V 

X 

X 

*13.  Use  minimum  dimension 
of  1/4  inch 

X 

X 

X 

X 

14.  Use  familiar  words 

V 

V 

V 

V 

15.  Ce  explicit  in  describing 
user  action 

V 

V 

V 

V 

\/-Ok 

0 " Violates  occasionally 

X • Violates  consistcmly 
* " Illustrations  involved. 
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Table  3 

Compliance  of  Four  Sample  Presentations 
(Envelope  Decision)  Against  Formatting  Rules 


1.  Use  graphic  as  primary 

2.  Use  narrative  to  support  graphic 

3.  Use  directive  form  ol 
instructions 

4.  Minimize  need  (or  transta- 


5.  Provide  graphic-narrative 
proximity 


Narrative-graphic  not  related;  psoximiiv  rule  is  academic. 
X « Major  violation. 

O » Occasional  violation. 

Ok. 


Documentation  Improvements 

Reformatting  the  ejection  information  in  the  T-2  NATOPS  manual  was  based  on  the  concept 
that  emergency  procedures  should  emphasize  clarity,  learning,  and  recall,  since  the  crewmember  is 
not  free  to  refer  to  the  manual  during  emergencies.  The  following  discussions  cover  the  formatting 
for  both  the  decision  and  procedural  presentations. 

Ejection  Decisionmaking 

Effective  decisionmaking  requires  a structure  to  show  the  types  of  decisions  to  be  made  and  the 
major  themes  to  be  accounted  for,  and  standards  to  guide  individual  decisions.  Current  NATOPS 
manuals  do  not  provide  the  structure  and  provide  only  complex  presentations  of  the  standards.  The 
decisionmaking  guidance  which  appeared  in  the  T-2  NATOPS  manual  was  revised  to  incorporate 
these  features.  The  specifics  of  there  revisions  are  discussed  below. 

Structure.  The  revised  write-ups  were  designed  to  provide  a structure  to  organize  and  channel 
the  decisionmaking  process.  The  structure  brought  into  balance  two  conflicting  themes:  (1)  the 
need  to  save  the  aircraft,  and  (2)  the  need  to  perform  a timely  ejection  if  necessary.  This  decision 
process  was  portrayed  in  a decision  tree  format  (Figure  3)  including  example  ejection  scenarios  (in 
parentheses). 
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This  figure  presents  the  ejection  timing  decision  in  diagrammatic  form.  As  shown  in  blocks  1 and  2, 
the  decision  is  made  on  the  basis  of:  (1)  envelope  assessment  and  (2)  aircraft  controllability.  Envelope 
assessment  is  defined  as  a judgment  on  how  close  the  aircraft  is  to  the  operating  limits  of  the  ejection 
system.  The  outcome  of  this  assessment  can  be  either  critical  (near  or  beyond  the  limit)  or  OK. 
Simultaneously,  block  2 of  the  diagram  calls  for  considering  aircraft  controlability  to  determine  whether 
it  is  possible  to  maintain  a good  envelope  or  to  improve  a critical  envelope.  The  outcome  possibilities  of 
this  judgment  are  either:  controllable  or  not  controllable.  The  results  of  both  judgments  are  combined 
giving  the  four  possibilities  shown  immediately  after  blocks  1 and  2. 

The  objective  in  applying  this  part  of  the  ejection  timing  procedure  is  to  characterize  the  aircraft 
situation  as  one  of  these  four  conditions.  The  emergency  noted  atop  each  condition  is  meant  to  typify 
that  condition  possibility.  For  example,  "fire  on  takeoff"  is  characterized  as  critical  envelope,  aircraft 
controllable.  Under  these  circumstances  the  pilot  should  simultaneously  improve  his  position  relative  to 
the  envelope  and  perform  appropriate  emergency  procedures.  If  the  emergency  procedure  resolves  the 
problem  a precautionary  landing  is  indicated.  If  the  emergency  persists,  ejection  can  be  initiated  under 
improved  envelope  conditions. 


Figure  3.  New  decision-making  structure. 
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Standards.  The  revised  write-ups  offer  two  types  of  standards  to  guide  ejection  decisionmaking. 
One  set  is  conservative  (a  large  safety  margin),  while  the  other  is  literal  (no  safety  margin).  This  dual 
standard  concept  is  compatible  with  current  ejection  philosophy,  which  states  that  the  probability 
of  a safe  ejection  decreases  as  one  approaches  the  limits  of  the  system.  An  innovative  feature  of  the 
literal  standards  deals  with  their  usability.  In  the  past,  literal  standards  have  been  presented  as 
multi-parametric  graphics,  difficult  to  memorize  and  recall  for  inflight  use.  Simple  rules  were 
devised  to  approximate  the  product  provided  by  the  more  complex  graphics.  Samples  of  both  types 
of  standards  appear  in  Figure  4. 

Operating  Procedures 

When  it  is  necessary  to  eject,  the  user  must  operate  the  hardware  quickly  and  without  error.  To 
help  the  user  achieve  this  performance  level,  equipment  operating  procedure  descriptions  should 
emphasize  organized  sequences  and  pictorial  descriptions.  The  existing  NATOPS  write-ups  did  not 
include  these  features.  Accordingly,  relevant  passages  were  revised  to  incorporate  the  desired 
performance-fostering,  presentation  features. 

Organized  Sequences.  To  facilitate  learning  and  recall,  the  steps  of  a procedure  should  be 
presented  in  organized  sequences,  which  break  the  procedure  into  small,  manageable  chunks.  The 
organized  sequence  used  to  improve  the  NATOPS  ejection  procedure  is  represented  in  Table  4. 

Pictorial  Descriptions.  Presentations  with  pictorial  support  tend  to  be  better  understood  and 
remembered  than  those  which  rely  heavily  on  verbal  descriptions.  Sitterley  (1974)  demonstrated 
that  careful  structuring  of  visual  cues  was  sufficient  to  “key”  the  “appropriate”  pilot  response,  even 
though  these  cues  were  presented  in  a static  and  still  form.  Figure  5 illustrates  this  format  feature 
with  a “before-and-after”  comparison  of  one  part  of  the  NATOPS  ejection  procedure. 

The  rewrite  techniques  discussed  above  were  applied  in  reformatting  the  ejection-relevant 
portions  of  the  Emergency  Section  of  the  T-2  NATOPS  manual.  The  resulting  write-up  was  then 
evaluated  to  determine  whether  the  desired  learning  and  recall  improvements  had  been  achieved. 
The  methodology  used  in  this  evaluation  is  summarized  in  the  next  section. 


8 


Conservative  Standard  (Partial) 


Literal  Standard  (Partial) 

MINIMUM  SAFE  EJECTION  ALTITUDES 
RATE  OF  DESCENT 


If  ejection  is  necessary  below  150 
kias  a second  lower  limit  of  75  kias 
is  recommended  to  minimize  risk  of 
collision  with  jettisoned  canopy. 


RULE:  Required  Altitude  s 3%  X Rate  of  Descent 


Example:  For  a 2000  fpm  Rate  of  Descant  at  300  KIAS 

a Altitude  » 3%  X 2000  - 60  feet  (vs.  35  from  the  Chart) 


Example:  For  a 3200  fpm  Rate  of  Descent  at  150  KIAS 

a Altitude  ■ 3%  x 3200  ■ 96  Feet  (vs.  83  from  the  Chart) 


If  bailout  is  considered  a maximum 
airspeed  of  250  kias  is  recommended 
to  ensure  clearance  of  the  tail 
section. 


RATE  OF  DESCENT 


00  3J0  4 

SPEED^-KIAS 


400  500  600 


Figure  4.  New  decision-making  standards 


Organization  Used  to  Present  Operating  Procedures 


1.  PREPARATORY 

II.  EJECT 

III.  DESCENT 

A.  Communicate 

A.  Initiate  Ejection 

A.  Parachute  Opening 

B.  Adjust  Equipment 

B.  Note  Autometic  Events 

B.  Prepare  for  Landing 

C.  Position  Body 

C.  Initiete  Alternate  Sequence 

C.  Landing 

D.  Initiate  Bailout 

n 
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1 CHICK  COMMAND  COCKPIT  IJECTION  SELECTOR  — ROTH  EJECT. 

1.  IE  TIME  PERMITS  WARN  CREWMAN  AND  FOLLOW  RADIO  DISTRESS  PROCEDURE 
3 LEVEL  WINDS  AND  MINIMIZE  RATE  OF  DESCENT 


5 TO  EJECT: 


I.  PREPARATORY 
C.  Portion  Body  for  Ejection 

1.  Plac*  heels  on  deck  and  balls  of  feat  on  rudder  pedals  (1) 

2.  Move  knees  outboard  with  thighs  as  flat  as  possible  on  seat  cushion  (2) 

3.  Push  buttocks  beck,  sit  erect  (3) 

4.  Move  head  back  against  headrest  and  hold  chin  up  (4) 


WARNING:  Incorrect  posture  increases  your  chances  of  injury  during  ejection 


Figure  5.  Pictorial  emphasis  in  the  new  NATOPS  write-ups. 
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Evaluation  Methodology 


Overview 


The  evaluation  was  designed  to  determine  how  much  subjects  learned  and  retained  from  a home 
study  of  either  the  conventional  or  improved  ejection  presentations.  Two  separate  subject 
populations  were  employed  to  help  accomplish  this  evaluation  objective:  an  untrained  group  of 
student  naval  flight  officers  (SNFOs)  and  a T-2  experienced  group  of  student  naval  aviators  (SNAs). 
The  responses  of  both  groups  to  paper  and  pencil  tests  was  one  means  of  assessing  the  learning 
effects  of  the  NATOPS  presentations.  In  addition,  the  SNAs  were  assessed  on  their  responses  to 
ejection  scenarios  presented  in  an  operational  flight  trainer  (OFT). 

Subjects 

Eighty -seven  SNFOs  assigned  to  a pre-training  pool  participated  in  one  part  of  the  evaluation. 
The  SNFOs  were  randomly  assigned  to  each  of  two  test  conditions.  Forty-two  students  were  placed 
in  the  experimental  group  and  45  students  in  the  control  group.  Thirty -eight  SNAs  were  used  in  a 
second  part  of  the  evaluation.  The  subjects  were  selected  randomly  from  the  population  of  T-2 
student  pilots  whose  extent  of  training  ranged  from  having  soloed  the  T-2  aircraft  (8th  week  of 
training)  to  having  completed  the  T-2  training  (20  weeks).  The  SNAs  were  divided  into  two  groups 
with  22  assigned  to  the  experimental  condition  and  16  to  the  control  condition. 

All  subjects  participated  in  three  paper  and  pencil  evaluation  sessions.  Subjects  were  informed 
prior  to  the  first  session  that  they  would  be  testing  information  presentation  techniques  covering 
the  ejection  procedures  section  of  the  NATOPS  manual.  They  were  requested  not  to  discuss  the 
study  material  with  each  other  for  the  duration  of  the  testing. 

Evaluation  Procedures 

The  experimental  design  is  outlined  in  Figure  6.  The  exhibit  shows  three  key  points  in  the 
evaluation  procedure:  the  pretest,  the  post-test,  and  the  retention  test.  The  SNFO  and  SNA 
evaluation  procedures  parallel  one  another  closely  with  two  exceptions: 

• During  the  post-test  period,  the  SNA  sample  was  exposed  to  the  simulator  test  in  addition 
to  the  paper  and  pencil  tests.  A counterbalanced  design  was  employed. 

• The  retention  period  was  increased  from  48  hours  for  the  SNFO  evaluation  to  7 days  for  the 
SNA  evaluation.  Both  retention  periods  were  based  on  subject  availability. 


11 


"WVPPPW 


* • 


A 20-minute  paper  and  pencil  pretest  was  administered  to  the  subjects  immediately  following  a 
briefing  which  outlined  the  purpose  of  the  testing.  After  the  pretests,  the  ejection  write-ups  were 
distributed.  The  subjects  in  the  experimental  group  received  the  ejection  write-ups  with  the  new 
formatting  techniques.  The  control  group  received  copies  of  the  existing  T-2  ejection  section. 
Subjects  in  each  group  were  requested  to  study  their  presentations  at  home  and  report  back  to  the 
test  room  in  48  hours  for  the  post-test.  Upon  completing  the  post -test,  subjects  were  requested  to 
return  after  their  appropriate  retention  period  had  elapsed  for  the  retention  test  session.  Their 
participation  ended  with  a short  debriefing. 

Test  Instruments 

Paper  and  Pencil  Test  Sessions.  The  pretests,  post-tests,  and  retention  tests  were  divided  into 
four  separate  content  areas: 

• Envelope  Assessment  — the  subject's  awareness  of  ejection  system  limits  and  knowledge  of 
the  specific  principles  and  relationships  involved  in  the  ejection  decision. 

• Ejection  Procedures  — knowledge  of  the  normal  and  alternative  steps  necessary  to  prepare 
for  and  operate  the  ejection  hardware. 

• Post-Egress  - knowledge  of  the  procedures  and  techniques  for  parachute  deployment, 
descent,  and  landing  over  terrain  or  water  (includes  seat-man  separation). 

• Equipment  Location  — the  ability  to  recognize  and  locate  equipment  involved  in  all  aspects 
of  safe  and  efficient  ejection. 

Each  of  the  three  tests  included:  situation-specific  questions  such  as  the  one  shown  in  Table  5, 
picture  markups  illustrated  in  Figure  7,  fill-in- the-blanks  or  multiple-choice  items. 

The  pretest  was  designed  to  determine  the  baseline  levels  of  the  subject’s  knowledge  of  the  four 
content  areas.  The  post-test  used  both  paper  and  pencil  tests  and  simulator  tests  to  measure  the 
effect  of  studying  the  ejection  write-ups.  The  final  paper  and  pencil  test  assessed  the  subject’s 
ability  to  recall  the  information  learned  from  the  write-ups  after  a retention  period  had  elapsed. 
Additional  information  regarding  test  development,  validation,  and  reliability  can  be  found  in 
Appendix  B. 


Simulator  Test  Sessions.  The  T-2  Operational  Flight  Trainer  was  used  to  present  two  ejection 
scenarios  to  the  SNA  subjects  participating  in  the  experiment.  These  scenarios  were:  fire  on  takeoff 
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and  loss  of  power  in  descent  (Appendix  B).  Figure  8 represents  the  loss  of  power  scenario  including 
probable  decision  points.  The  scenarios  were  developed  with  the  cooperation  of  T-2  instructor 
pilots.  The  responses  of  the  SNAs  to  the  scenarios  were  recorded  in  a checklist  format  by  instructor 
pilots. 

Table  5 

Situation-Specific  Test  Item 


Test  Section  I 

1)  Situation:  You  lost  control  of  the  aircraft  at  10,000 

feet.  Attempts  to  regain  control  have  been  unsuccessful. 
Your  flight  conditions  are: 

• Rate  of  descent  5000  fpm 

• Airspeed  350  KIAS 

• 60°  Adverse  Angle 

• Dive  Angle  15° 

• Altitude  8000  feet 

a)  Under  these  conditions  the  minimum  altitude 

required  for  safe  ejection  is  feet. 


b)  Describe  the  basis  for  your  response  to  Question  1 
above 
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Figure  8.  Loss  of  power  ejection  scenario. 
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Results 

The  evaluations  were  designed  to  show  whether  the  reformatted  version  of  the  ej“ction 
information  was  more  effective  than  the  current  NATOPS  presentations,  with  effectiveness 
measured  in  terms  of  initial  learning,  retention,  and  net  information  gain.  The  results  of  the 
analysis*  are  summarized  in  Table  6 and  Figure  9. 

Paper  and  Pencil  Tests 

Three  paper  and  pencil  tests  were  used  to  measure  initial  learning,  retention,  and  net 
information  gain.  Initial  learning  was  measured  by  the  differences  in  scores  attained  in  the  pre-  and 
post-tests;  retention  was  measured  by  the  differences  in  scores  attained  in  the  post-  and  retention 
tests;  and  net  information  gain  was  measured  by  the  differences  in  scores  attained  in  the  pre-  and 
retention  tests.  Table  6 indicates  the  direction  and  statistical  significance  of  these  score  differentials 
for  the  four  study  groups.  Observations  about  these  measures  are  as  follows: 

• Statistically  significant  net  information  gains  are  found  in  all  four  content  areas  for  the 
experimental  group  of  SNFOs  and  in  three  of  four  content  areas  for  the  experimental 
group  of  SNAs.  The  “no  change”  status  achieved  by  the  SNA  sample  is  in  the  equipment 
location  content  area,  where  there  was  improvement  during  the  study  phase  of  the 
evaluation  but  a loss  of  information  during  the  retention  period. 

• The  existing  T-2  ejection  section  which  was  presented  to  the  control  groups  demonstrated 
little  contribution  in  the  overall  pretest/retention  test  evaluations.  The  sole  net 
information  gain  recorded  for  the  control  subjects  occurred  in  the  procedures  content  area 
for  the  SNFOs,  with  a gain  from  pretest  to  post-test  and  no  appreciable  loss  from  the 
post-test  to  the  retention  test. 

• The  characterization  column  of  Table  6 presents  both  verbal  and  numerical  descriptions  of 
the  gains-losses  for  each  of  the  three  learning  effects.  This  part  of  the  exhibit  shows  that 
the  experimental  presentations  produced  results  that  were  superior  to  the  conventional 
presentation  in  all  cases. 

Figure  9 is  a graphic  summary  of  the  differences  between  the  experimental  and  control  groups; 
it  also  dramatizes  the  magnitude  of  the  learning  improvements  produced  by  the  experimental 
formats. 

• In  all  eight  post-test  conditions,  the  experimental  group's  performance  was  statistically 
better  than  the  control  group's  (as  indicated  by  the  ovals).  The  consistent  pretest  baseline 
levels  indicate  the  homogeneity  of  the  samples  used  in  the  study,  as  well  as  the  level  of 
performance  of  the  subjects  entering  into  the  evaluation. 


A detailed  presentation  of  the  statistical  analysis  with  charts  and  tables  is  included  in  Appendix  A. 
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Table  6 

Summary  of  the  Statistical  Evaluation 


t - statistically  significant  Incraaaa. 

$ - no  statistical  tlgnHIcanca  Indicated, 
i • statistically  significant  decrease. 

*Tha  amount  of  loss  was  statistically  negligible,  but  sufficient  to  negate  the  gain  achieved  during  the  post-tact. 
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• In  all  four  of  the  SNFO  retention  test  conditions,  the  experimental  group  registered 
performances  statistically  greater  than  those  of  the  control  group.  Regarding  the  SNA 
sample,  the  experimental  group  showed  statistically  superior  net  information  gains  in  only 
one  of  the  four  content  areas.  However,  an  examination  of  the  graphic  shows  that  the  trends 
of  experimental  group  scores  were  superior  to  those  of  the  control  groups. 

• In  no  instance  was  the  control  group  superior  to  the  experimental  group. 

Simulation  Tests 

In  addition  to  the  paper  and  pencil  tests  used  during  the  SNFO  and  SNA  evaluations,  the  SNAs 
were  tested  on  selected  ejection  scenarios  using  the  T-2  operational  flight  trainer  (OFT).  The 
scenarios  were  administered  during  the  post-test  phase  of  the  evaluation.  The  results  (Figure  10) 
show  the  superiority  of  the  experimental  group  for  the  fire  on  takeoff  scenario.  Statistical  analysis 
(Table  A-2  in  Appendix  A)  revealed  the  experimental  group  scored  significantly  better  than  the 
control  group.  The  loss  of  power  in  descent  scenario  failed  to  differentiate  between  the  groups. 


Figure  10.  Simulator  testing  results. 
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Discussion 

1 ne  evaluation  results  demonstrate  that  the  experimental  presentations  produced  consistent 
and  large  amounts  of  initial  learning.  This  is  especially  impressive  in  light  of  the  time  actually  spent 
studying  the  material  (less  than  two  hours)  and  the  informal,  uncontrolled  study  setting  (home). 

The  net  information  gain  for  the  experimental  groups  was  appreciably  greater  for  all  content 
areas  tested  than  that  of  the  control  groups.  The  rate  of  retention  was  consistent  for  both  the 
experimental  and  control  groups,  thereby  demonstrating  that  the  initial  learning  was  responsible  for 
the  superior  net  gains  recorded  by  the  experimental  group. 

The  OFT  testing  indicated  that  the  performance  of  the  experimental  group  was  superior  to  that 
of  the  control  group  for  one  of  the  two  emergency  scenarios  (fire  on  takeoff).  The  remaining 
scenario  failed  to  differentiate  the  two  groups,  with  both  the  experimental  and  control  group 
scoring  very  high.  It  was  later  learned  that  the  loss  of  power  emergency  was  practiced  repeatedly 
during  training  flights  thereby  achieving  an  unimprovable  level  of  performance. 

The  gains  demonstrated  by  the  paper  and  pencil  tests  in  the  envelope  assessment  and  ejection 
procedures  content  areas  are  especially  relevant  since  these  are  aspects  of  ejection  which  are  most  in 
need  of  improvement.  The  gains  demonstrated  by  the  SNFOs  are  promising  also  since  the 
inexperienced  crewmembers  are  a primary  target  of  this  NATOPS  manual. 

Recom  mendations 

The  experimental  results  of  this  project  show  that  the  new  write-ups  increase  the  user’s 
awareness  of  the  ejection  envelope  parameters  and  improve  his  grasp  of  the  procedures  necessary  to 
operate  the  hardware.  It  appears  reasonable  that  these  improvements  can  have  a positive  effect  on 
crewmembers’  performance  and  thus  on  the  survival  rate  for  ejections.  Accordingly,  it  is 
recommended  that  steps  be  taken  to  make  available  to  the  Fleet  ejection  information  prepared  in 
the  formats  developed  in  this  study.  The  introduction  of  these  ejection  presentations  into  the  Fleet 
should  consider  the  following  possibilities. 
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Applications 

1.  Update  the  T-2  ejection  presentations  in  accordance  with  the  presentations  prepared  during 
this  project. 


(a)  Limit  the  modifications  to  the  ejection  information  appearing  in  the  Emergency 
Section  of  the  NATO  PS  manual. 


(b)  Descent,  landing  survival  and  recovery  should  be  excluded  from  the  modification  since 
these  considerations  were  outside  the  scope  of  the  present  study. 


2.  Consider  the  development  of  a specification  to  guide  the  preparation  of  future  ejection 
information  presentations. 


Additional  Research 


3.  Develop  and  test  similar  ejection  presentations  for  operational  aircraft  and  experienced 
crewmembers. 


(a)  Cover  both  the  envelope  assessment  and  equipment  operating  procedures. 

(b)  Consider  format  modifications  to  emphasize  rehearsal  and  proficiency  over  initial 
learning. 

4.  Apply  and  test  the  reformatting  method  in  other  areas  where  performance  improvement  is 
needed.  Specifically,  consider  applying  the  reformatting  method  to: 

(a)  The  descent,  landing,  survival  and  recovery  portions  of  the  process. 


(b)  The  procedures  for  handling  emergencies  and  the  interface  between  an  emergency  and 
the  ejection  decision. 
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Paper  and  Pencil  Tests 

Paper  and  pencil  tests  were  used  to  detect  any  learning  differences  produced  by  the  current  and 
experimental  methods  of  presenting  ejection  information  in  the  T-2  NATOPS  manual. 


The  paper  and  pencil  test  data  were  analyzed  by  a 2x3  Lindquist  type  1 repeated  measure 
design  (Table  A-l).  The  subsequent  multiple  range  comparisons  between  the  results  of  each  of  the 
test  sessions  for  the  content  areas  was  demonstrated  through  the  Tukey  tests.  This  particular  test 
was  chosen  because  it  guarantees  the  alpha  level  for  all  comparisons  to  be  no  greater  than  the 
specified  alpha.  The  T-test  was  used  to  analyze  the  pair-wise  differences  between  the  experimental 
and  control  groups  over  the  test  session.  In  all  cases,  the  .05  level  of  significance  was  used.  A power 
analysis  was  conducted  on  the  significant  SNA  F table  data  in  order  to  verify  the  analysis. 


Experimental  Analysis 


Retention  Test 


Pretest 


Experimental 


Control 


The  statistical  charts  and  tables  produced  by  this  evaluation  follow. 
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STUDENT  NAVAL  AVIATORS 

Content  Area:  Envelope  Assessment 


F -Table  (Lindquist  Type  1 2X3  repeated  measures) 


Source 
of  Variation 

Degree 
of  Freedom 

Sum 

of  Squares 

Mean 

Square 

F-Ratio 

(Mixed) 

Test 

2 

2,435.84 

1,217.92 

1.345 

Group 

1 

1,167.27 

1,167.27 

5.947* 

TxG 

2 

1,810.54 

905.27 

4.612* 

Exp.  Error 

108 

21,199.30 

196.29 

26,612.95 


Tukey  Test  (Within  group  differences) 


Power 

Group 

TxG 


Content 

Area 

Group 

N 

Op/N 

df 

.01 
° .05 

HSD 

Xi-Xj  i*j 

Ejection 

Assess- 

Experi- 

mental 

22 

3.3478 

3,  63 

4.28 

3.40 

14.3286 

11.3825 

*pr.-*po,t  =-19-409** 
Kpra-Kret  = -12-045* 

W*re,  = 7363 

ment 

Control 

16 

2.8052 

3,45 

4.35 

3.43 

12.2026 

9.6218 

Xpr.-*po,t  = - 9-1200 

*pr.-*ra,  = 13750 

*po«-Kr.t  - I50 

T-Test  for  Experimental  Group  vs.  Control  Group  (two  tailed) 


Content  Area 


Pretest 

Post-Test 

Retention 

Test 

-1.0429 

4.2150** 

1.7376 

Significant  at  the  .05  level. 
Significant  at  the  .01  level. 
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Tukey  Test  (Within  group  differences) 


Content 

Area 

Group 

N 

Op/N 

df 

.01 
° .05 

HSD 

Xi-Xj  i*j 

Ejection 

Experi- 

mental 

22 

1.9883 

3,63 

4.28 

3.40 

8.5099 

6.7602 

Xpr,- Xpost  = -12.227“ 
Xpr.-Xr„  = -10.864“ 
Xpos,-Xre,  = 1-364 

Procedures 

Control 

16 

2.4338 

3,45 

4.35 

3.43 

10.587 

8.3479 

Xpr. -'Xpost  = - 7 3125 
Xpre-Xre,  = “ 1-625 
Xpost-Xr.,  = 5.6875 

T-Test  for  Experimental  Group  vs.  Control  Group  (two  tailed) 


Content 

Area 


Pretest 

Post-Test 

Retention 

Test 

0.9105 

4.9314“ 

3.6764“ 

Significant  at  the  .05  level. 
’Significant  at  the  .01  level. 
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F-Table  (Lindquist  Type  1 2X3  repeated  measures) 


Source  Degree  Sum 

of  Variation  of  Freedom  of  Squares 


2,749.18 

318.76 

579.98 

14,522.92 


18,233.83 


STUDENT  NAVAL  AVIATORS 
Content  Area:  Post  Egress 


Mean 

Square 


1,374.59 

381.76 

289.99 

134.47 


F-Ratio 

(Mixed) 


Power 

Tests  = .82 


Tukey  Test  (Within  group  differences) 


Content 

Area 

Group 

N 

Op/N 

df 

.01 

a 

.05 

HSD 

Xi-Xj  i*j 

Post 

Experi- 

mental 

22 

2.5944 

3,63 

4.35 

3.43 

11.1040 

8.8210 

Xpre— Xpost  = —16.1818** 

Xpre— Xr.t  = -10.091* 
Xpost-Xre,  = 5.0905 

Egress 

Control 

16 

2.6859 

3,45 

4.28 

3.40 

11.6837 

9,2126 

Ve-Xpost  = 6.1250 

Xpr.-Xr.t  = 1-8125 

Xpost-Xret  = -».3125 

T-Test  for  Experimental  Group  vs.  Control  Group  (two  tailed) 


Retention 

Pretest 

Post-Test 

Test 

Content  _o.7053 

4.8233** 

1.3225 

Area 

Significant  at  the  .05  level. 
’Significant  at  the  .01  level. 
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STUDENT  NAVAL  AVIATORS 


.. 


tfk 


• H 


F-Table  (Lindquist  Type  1 2X3  repeated  measures) 


Tukey  Test  (Within  group  differences) 


Content  Area:  Equipment  Location 


Source 

Degree 

Sum 

Mean 

F-Ratio 

* • 

of  Variation 

of  Freedom 

of  Squares 

Square 

(Mixed) 

1 * 

Test 

2 

763.28 

381.64 

4.378* 

p? 

Group 

1 

763.19 

763.19 

6.535* 

• 4 

TxG 

2 

174.35 

87.18 

0.7465 

Exp.  Error 

108 

12,612.62 

116.78 

Total 

113 

14,313.44 

Power 

Tests 

Group 


.66 

.52 


Content 

Area 

Group 

N 

Op/N 

df 

.01 
® .05 

HSD 

Xj-Xj  i*j 

1 - 

X -X  „ = -8.227* 

Experi- 

4.28 

9.8466 

ri 

Equipmenl 

22 

2.3006 

3,63 

X -X„t  = -7.000 

mental 

3.40 

7.8220 

U 

= 1227 

post  ret 

X -X  = -2.25 

i J 

4,  35 

11.7763 

pre  post 

Location 

Control 

16 

2.7072 

3,  45 

X — X = -2.812 

3,  43 

9.2857 

pre  ret 

r 

Xpo«-Xre,  =-°'563 

I 


F-Table  (Lindquist  Type  1 2X3  repeated  measures) 


Source 


Degree 
of  Freedom 

Sum 

of  Squares 

2 

67,520.61 

1 

50,730.86 

2 

32,758.29 

255 

53,848.12 

260 

204,857.87 

Mean 

Square 


33,760.30 

50,730.86 

16,379.14 

211.1691 


F-Ratio 

(Mixed) 


2.0612 

240.24** 

77.56** 


Tukey  Test  (Within  grpup  differences) 


Content 

Area 

Group 

N 

Op/N 

df 

.01 
“ .05 

Ejection 

Experi- 

mental 

45 

2.3757 

3,  132 

4.18 

3.35 

Assess- 

merit 

Control 

42 

1.9835 

3,  123 

4.20 

3.36 

T-Test  for  Experimental  Group  vs.  Control  Group  (two  tailed) 


Content  Area 


Significant  at  the  .05  level. 
’Significant  at  tha  .01  level. 


9.9304 

7.9586 


Xi- 

Xj  i*j 

*pre-*po«, 

= -57.6** 

X -X 

pre  A ret 

= -55.7** 

X 

post  ret 

= 1.87 

X -X 
pre  post 

= -13.5** 

X -X 
* pre  * ret 

= - 5.36 

X -X 

” post  ret 

= 8.12* 

Pretest 

Post-Test 

Retention 

Test 

-1.5189 

13.9343** 

12.2178** 
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STUDENT  NAVAL  FLIGHT  OFFICERS 

Content  Area:  Ejection  Procedures 


F-Table  (Lindquist  Type  1 2X3  repeated  measures) 


4 • 

Source 
of  Variation 

Degree 
of  Freedom 

Sum 

of  Squares 

Mean 

Square 

F-Ratio 

(Mixed) 

■y 

Test 

2 

12,334.74 

6,167.37 

31.785* 

« m 

Group 

1 

13,104.18 

13,104.178 

77.360** 

TT 

TxG 

2 

388.07 

194.037 

1.1455 

4 4 

Exp.  Error 

255 

43,194.76 

169.39 

* • 

Total 

260 

69,021.76 

Tukey  Test  (Within  group  differences) 


Content 

Area 

Group 

N 

Op/N 

df 

.01 
a .05 

HSD 

Xi-Xj  i*j 

Ejection 

Experi- 

mental 

45 

2.8547 

3,132 

4.18 

3.35 

11.932 

9.432 

Ve-Spos,  = -182113** 
Ve-*re«  = -15.482** 
Xpo„-Xret  = 2.7291 

Pro- 

cedures 

Control 

42 

2.7105 

3,123 

4.20 

3.36 

11.3841 

9.107 

Xpre-Xpost  = -13.5445” 
Xpre-Xr„  = -10.46* 
Xpo„-Xre,  = 3.07 

T-Test  for  Experimental  Group  vs.  Control  Group  (two  tailed) 


STUDENT  NAVAL  FLIGHT  OFFICERS 

Content  Area:  Post  Egress 


F-Table  (Lindquist  Type  1 2X3  repeated  measures) 


Source 
of  Variation 

Degree 
of  Freedom 

Sum 

of  Squares 

Mean 

Square 

F-Ratio 

(Mixed) 

Test 

2 

15,012.62 

7,506.31 

3.58 

Group 

1 

4,581.78 

4,581.78 

19.72* 

TxG 

2 

4,193.47 

2,906.74 

9.03* 

Exp.  Error 

255 

59,237.09 

232.30 

83,024.97 


Tukey  Test 


Content 

Area 


Group 

N 

Op/N 

df 

.01 

01  .05 

HSD 

Xi-Xj  i*j 

Experi- 

mental 

45 

2.1261 

3,132 

4.18 

3.35 

8.8871 

7.1224 

^pre-Xpos,  =-21-91”" 
Ve^ret  = -17333** 

*pos,-*re,  - 45778 

Egress  Control  I 42  2.5038  3,123 


4.20  10.5160 

3.36  8.4128 


T-Test  for  Experimental  Group  vs.  Control  Group  (two  tailed) 

Pretest 

Post-Test 

Retention 

Test 

Content  Area 

-0.1376 

3.6986** 

4.2911** 

Significant  at  the  ,05  level. 
Significant  at  the  .01  level. 


I 


*4 


t 


Source 
of  Variation 

Degree 
of  Freedom 

Sum 

of  Squares 

Mean 

Square 

F-Ratio 

(Mixed) 

2 

10,374.99 

5,187.49 

2.1991 

1 

40,943.38 

40,943.38 

73.5694** 

TxG 

2 

4,717.82 

2,358.91 

4.2386* 

Exp.  Error 

255 

141,914.37 

556.52 

Total 

?60 

197,950.55 

STUDENT  NAVAL  FLIGHT  OFFICERS 

Content  Area:  Equipment  Location 


F-Table  (Lindquist  Type  1 2X3  repeated  measures) 


Tukey  Test  (Within  group  differences) 


Content 

Area 

Group 

N 

Op/N 

df 

.01 
“ .05 

HSD 

X,-Xj  i 4 j 

Equip- 

ment 

Location 

Experi- 

mental 

45 

3,132 

4.18 

3.35 

21.261 

17.0394 

Xpr.-*po.«  " -25.4047** 
V.-*",  » -18  979* 
Xpo,t-*re,  " *>.4256 

Control 

42 

4.807 

3,123 

4.20 

3.36 

20.1894 

16.1515 

V.-Xpo„  " -4.4H2 
V.-Xre,  - -2.6518 
Xpo,«-Xr„  « 1 7565 

T-Test  for  Experimental  Group  vs.  Control  Group  (two  tailed) 


Li 


Table  A-2 

Simulator  Scenarios,  SNA  Sample  Population 


T-Test  for  Experimental  vt.  Control  Group 


The  performances  of  the  experimental  and  control  SNA's  on  the  OFT  scenarios  were  analyzed  through  the  T-test  procedure,  noted 
below: 


(A)  LOSS  POWER  IN  DESCENT 


Group 

N 

~X 

O 

T 

Experimental 

22 

95.41 

7.27 

0.97 

Control 

16 

92.0 

14.07 

(B)  FIRE  ON  TAKEOFF 


Group 

N 

X 

a 

T 

Experimental 

22 

44.09 

26.75 

2.34* 

Control 

16 

25.81 

18.82 

Group 

N 

X- 

a 

T 

Experimental 

22 

69.59 

13.62 

Control 

16 

58.56 

11.70 

Alpha  .06  level  with  critical  value  of  2.03  (two  tailed! 
“Alpha  .01  level  with  critical  value  of  2.72  (two  tailed) 
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APPENDIX  B 
TEST  DEVELOPMENT 


• Paper  and  Pencil  Tests 

• OFT  Simulator  Tests 


Pape'  a.xl  Pencil  Testa 

Preliminary  paper  and  pencil  testa  were  developed  based  on  an  analysis  of  the  performance 
requirements  outlined  in  the  NATO  PS  manual.  The  preliminary  tests  were  then  given  to  pilot 
instructors  at  NAS  Pensacola  who  validated  the  content  of  the  tests  and  suggested  modifications. 

Each  of  the  tests  (i.e.,  the  pre-,  post-,  and  retention  tests)  was  divided  into  the  four  content 
areas  described  earlier.  Tlie  post-test  battery  was  developed  first.  The  pretest  and  retention  tests 
were  split  half  versions  of  this  post-test.  The  point  totals  of  each  of  the  tests  are  presented  in 
Table  B-l. 


Table  B-l 

Total  Possible  Points  for  Paper  and  Pencil  Tests 


Pretest 

Post -Test 

Retention  Test 

Ejection  Assessment 

12  points 

25  points 

1C  points 

Ejection  Procedure 

15  points 

45  points 

18  points 

Post  Egress 

10  points 

25  points 

10  points 

Equipment  Location 

12  points 

30  points 

10  points 

The  ratio  of  correct  responses  over  total  points  yielded  the  percentage  scores  used  during  the 
evaluation.  The  range  of  scores  recorded  for  each  group  is  listed  in  Tables  B-2  and  B-3. 


Reliability 

The  functional  unity  of  the  tests  was  measured  by  computing  the  internal  consistency 
reliability  for  each  of  the  content  areas  using  the  data  collected  during  the  post-test  phase  of  the 
SNFO  evaluation. 


Ejection  Assessment 

_L=  .85 

Ejection  Procedure 

j.  = .76 

Poet  Egreee 

X=  -78 

Equipment  Location 

<N 

GO 

II 

H 

Hie  reliability  coefficients  obtained  were  sufficiently  high  in  each  instance  to  demonstrate  the 
communality  of  the  questions  covering  each  of  the  content  areas. 


f 
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Table  B-2 

Range  of  Scores  for  Paper  and  Pencil  Tests 
Student  Naval  Flight  Officers 


Pretest 


Ejection  Assessment 


Ejection  Procedures 


Experimental 


Control  10  — 66 


Post  Egress 


Experimental  30  - 100 


Control  33-100 


Equipment  Location 


Post-Test 


53-89 


-72 


-96 


48- 


Retention  Test 


Experimental 

0-42 

31-94 

11  -86 

Control 

0-33 

7-50 

0-57 

37-92 


21-84 


14-100 


14-93 


Experimental 

0-84 

35-100 

10-100 

Control 

10-77 

11-76 

10-100 

(All  scorn  listed  above  are  percentages.) 


Table  B-3 

Range  of  Scores  for  Paper  and  Pencil  Tests 


« « 


Li 

I 1 


I r 

l 

Student  Naval  Aviators 


! 

Pretest 

Post -Test 

Retention  Test 

Ejection  Assessment 

Experimental 

32-100 

58-100 

30-100 

Control 

42-75 

42-80 

46-91 

Ejection  Procedures 

Experimental 

60-100 

72-94 

63-100 

LJ 

Control 

50-100 

68-85 

50-95 

Post  Egress 


Experimental 

28-100 

83-100 

57-100 

Control 

65-90 

76-96 

57  - 100 

Equipment  Location 


Test  Validation 


Content  Validity 

The  use  of  pilot  instructors  to  assess  the  test  coverage  of  the  content  during  the  preparation  of 
the  item  specifications  helped  ensure  the  sampling  adequacy  of  the  tests,  thus  establishing  a 
relatively  high  degree  of  content  validity. 

Criterion  Referenced  Validity 

Second  order  criterion  referenced  validity  coefficients  were  computed  using  the  Student  Naval 
Aviator  post-test,  ejection  assessment  scores,  and  the  scores  obtained  by  the  SNAs  during  the  OFT 
testing.  The  correlation  coefficients  appear  below: 

• Ejection  Assessment/Fire  on  Takeoff  r = .35* 

• Ejection  Aseessment/Power  Loss  r = .04 

• Ejection  Assesement/OFT  Scenarios  Combined  _r_  = .35* 

OFT  Simulation  Tests 

The  simulation  tests  included  the  “Loss  of  Power”  and  “Fire  on  Takeoff”  scenarios,  both  of 
which  required  an  eventual  ejection.  The  purpose  of  the  OFT  tests  was  to  determine  what 
procedures  the  SNAs  initiated  at  the  commencement  of  the  emergency  exercise,  how  they  handled 
the  situation  throughout,  and  at  what  point  they  initiated  the  “inevitable”  ejection.  The  SNAs  were 
not  aware  ahead  of  time  that  ejection  would  be  required  eventually. 

The  ejection  scenarios  paralleled  the  programming  capabilities  of  the  OFT  and  were  developed 
with  the  cooperation  of  pilot  instructors  at  NAS  Meridian. 


A checklist  of  scenario  performance  options  was  monitored  throughout  the  testing  with 
weighted  scores  assigned  to  each  of  the  responses.  The  weighting  scheme  was  developed  with  the 
cooperation  of  pilot  instructors.  This  scheme,  a proximal-distal  continuum,  was  based  on  optimal 
ejection  points  identified  within  the  scenarios.  Summary  outlines  of  the  scenarios  are  presented  in 
graphic  and  flow  chart  form  in  Figures  B-l,  B-2  and  B-3. 


Daacant,  patting  through 
10,000  ft.  250KIAS 
4000  fpm  1 0 milat  to  f iald 


Powar  loti,  both  anginat 
9,000  ft.  250  KIAS 
4000  fpm 


Bagin 

Precautionary 


Try  for 
rattartt 


Rattart  Rattart  left  angina 
10,000  ft.  180  KIAS 
2000  fpm 


Bagin 

Pracautionary 


Figure  B-l.  Loas  power. 


Rattart  left  angina 
6000  ft.  180  KIAS 
4000  fpm 


Try  mora 
rattartt 


Rattart  right  angina 
3000  ft.  180  KIAS 
4000  fpm 


Dacition  Point 


Attampt 
no  thrutt 
landing 
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B-2.  Fire  on  takeoff. 


Each  of  the  scenarios  was  worth  a total  of  25  points.  The  scores  were  then  converted  into 
percentages  and  evaluated  accordingly.  The  range  of  scores  recorded  for  each  scenario  is  listed  in 
Table  B-4. 


Table  B4 

Range  of  Scores  for  OFT  Simulation  Tests  (SNA) 


Group 

Fire  on  Takeoff 

Power  Loss 

5?  Combined 

Experimental 

17  - 100 

83-100 

50-100 

Control 

17-75 

50-100 
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